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c) performing an orthogonal transformation on the formatted unlabeled data 
to produce a set of unlabeled data transform coefficients; 

d) formatting the^igital watermark data into a format suitable for orthogonal 
transformation; 

e) performing an ortlk)gonal transformation on the formatted watermark data 
to produce a set of watermark data transfonn coefficients; 

f) for each watermark dal^a transform coefficient, allocating an unlabeled data 
transform coefficient to be replaced and replacing the respective unlabeled data transform 
coefficients to produce a labeled set of data transform coefficients; 

g) storing the locations into which watermark data transform coefficients 
were encoded in the set of labeled data transform coefficients to generate a unique key for future 
decoding of the watermark data; 

h) performing an inverse orthogonalMransformation on the labeled data 
transform coefficients to convert them into a set of labeleciydigital data having a form resembling 
the original unlabeled digital data. 



1 66. The method of claim 65 wherein the step of fomratting the watermark data 

2 includes the step of mapping the set of watermark data into a two-uimensional matrix. 

1 67. The method of claim 66 wherein the step of formattinathe watermark data 

2 includes the step of dividing the two-dimensional matrix of watermark flata into smaller sub- 

3 blocks and the step of performing the orthogonal transformation on the wVtermark data involves 

4 performing the orthogonal transform on each sub-block of the watermark data, such that the 
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watermark data transform coefficients are organized in sub-blocks. 

68. The method as claimed in claim 67, including an ordering step in which each sub- 
block of the watermark data transforrrk coefficients are reordered into a one-dimensional array in 
approximately increasing frequency ordW, as hereinbefore defined, prior to replacement of the 
allotted unlabeled data transform coefficieWs with the watermark data transform coefficients. 

69. The method of claim 68, in which the step of reordering the watermark data 
transform coefficients of each sub-block is achieved by performing a zig-zag scan of the 
watermark data transform coefficients in the respecrive sub-block. 

70. The method of claim 68, in which the steX of reordering the watermark data 
transform coefficients of each sub-block is achieved by penorming a radial scan of the 
watermark data transform coefficients in the respective sub-block . 

71 . The method as claimed in claim 69, wherein after the watermark data transform 
coefficients of each sub-block are reordered into a one-dimensional array and before the 
replacement of unlabeled data transform coefficients with the waterma^ data the watermark data 
transform coefficients of each one-dimensional array are rescaled. \ 

72. The method as claimed in claim 71, wherein the rescaling is performed using a 
scaling function that reduces the magnitude of lower frequency coefficients of the one- 

NY02: 296577.1 \ 



A33766 PCX USA - 065141.01 17 



PATENT 



73. The method of claim\2, wherein the scaUng function has an exponential 
characteristic. 

74. The method of claim 68 including the step of dividing the reordered watermark 
data transform coefficients of each sub-block mto segments for subsequent replacement into the 
set of transformation coefficients of the unlabeleCi data. 

75. The method as claimed in claim 65, wherein the step of formatting the unlabeled 
data includes the step of mapping the set of unlabeled data into a two dimensional matrix. 

76. The method of claim 75 wherein the step of fotaiatting the unlabeled data 
includes the step of dividing the two-dimensional matrix of unl^)eled data into smaller sub- 
blocks and the step of performing the orthogonal transformation on the unlabeled data involves 
performing the orthogonal transform on each sub-block of the unlabeled data, such that the 
unlabeled data transform coefficients are organized in sub-blocks. 



77. The method of claim 76, including a first ordering step in wnkh each sub-block of 
the unlabeled data transform coefficients are reordered into a one dimensional array in 
approximately increasing frequency order, as hereinbefore defined, prior to replacement of 
allocated unlabeled data transform coefficients with watermark data transform coemcients, and a 
second ordering step in which each of the one-dimensional arrays of the labeled data ttansform 
coefficients are reordered into sub-blocks using an inverse reordering to that of the first Vdering 
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step.' 
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78. \ The method of claim 77, wherein the first ordering step is achieved by 
performing a ^ig-zag scan of each sub-block of the unlabeled data transform coefficients and the 
second ordering step is achieved by performing an inverse zig-zag scan of each one-dimensional 
array of the labeled data transform coefficients. 



79. The methodsof claim 77, wherein first ordering step is achieved by performing a 
radial scan of each sub-block G»f the unlabeled data transform coefficients and the second 
ordering step is achieved by permrming an inverse radial scan of each one-dimensional array of 
the labeled data transform coefficients. 



■Fi S 

4'! 



80. The method of claim 78, inoJuding the step of, for each one-dimensional 
array of unlabeled data, determining a locatio\ beyond which the ac energies will fall below a 
certain threshold value and selecting transform CG^pfficients beyond that location for replacement 
by transform coefficients of the watermark data. 



1 81. The method of claim 80, including the step\)f calculating the mean and variance 

2 values of the ac energies fi:-om the orthogonal transformation cjoefficients for each one- 

3 dimensional array of unlabeled data and calculating the thresholoyvalue as a fimction of the mean 

4 and variance values. 



82. The method as claimed in claim 76, including the step of, fbr each one 
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dimensional array of the unlabeled data, allocating a segment of the orthogonally transformed 
watermark data that will be encoded in that sub-block, if any. 

83. The method as claimed in claim 65, wherein the orthogonal transform performed 
on the unlabeled data is selected from the group consisting of a Discrete Cosine Transform 
(DCT); a Fourier transform; a Walsh-Hadamard transform; a Haar transform; a sine transform; 
and a Wavelet transform, and the inverse^transform is respectively; an inverse DCT; an inverse 
Fourier transform; an inverse Walsh-Hadamard transform; an inverse Haar transform; an inverse 
sine transform; and an inverse Wavelet transform. 

84. The method as claimed in claim 83\^ wherein the orthogonal transform performed 
on the unlabeled data is a Discrete Cosine Transform (DCT) and the inverse transform is an 
inverse DCT. \ 

85. The method as claimed in claim 65, whereiUithe orthogonal transform performed 
on the watermark data is selected from the group consisting of a Discrete Cosine Transform 
(DCT); a Fourier transform; a Walsh-Hadamard transform; a Haar transform; a sine transform; 
and a Wavelet transform. \ 

86. The method as claimed in claim 85, wherein the orthogbnal transform performed 
on the watermark data is a Discrete Cosine Transform (DCT). \ 

87. The method as claimed in claim 65, including the further stepVf allocating in a 
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2 structured manner a segment of theWhogonally-transformed unlabeled data that will be replaced 
by each segment of orthogonally tranatformed watermark data. 

1 88. The method as claimed inVlaim 65, including the further step of allocating in a 

V 2 random manner a segment of the orthogon^ly-transformed unlabeled data that will be replaced 

3 by each segment of orthogonally transformecWatermark data. 

1 89. The method as claimed in claim 65, wherein the set of unlabeled digital data is 

C-^ \ 

2^ obtained from a sample stream representing a digitized grayscale or color image. 

lrr| 90. The method as claimed in claim 89, whWein the digitized grayscale or color 

2^ image is obtained from a digital still camera or a digital miage scanner. 

5 \ 

^sl \ 
p : ; \ 

If n 91 . The method as claimed in claim 65, wherein me set of unlabeled digital data is 

Zf i obtained from a sample stream representing digitized video. \ 

1 92. The method of claim 91, wherein the unlabeled dig\tized video is obtained from a 

2 Data Storage Medium (DSM), or a real time digital data source. \ 

1 93. The method as claimed in claim 65, wherein the labeled digitized video is 

2 subsequently transmitted over a digital communications channel. \ 

1 94. The method as claimed in claim 65, wherein the labeled digitized video is 
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subsequently recorded on a digital recording medium. 

95. The method as claimed in claim 94, wherein the digital recording medium is 
selected from the group consisting oV a Video Compact Disc (VCD); a Laser Disc (LD); a Digital 
Versatile Disc (DVD); a digitized movie and a still image contained within a video game, video- 
on-demand or other software. \ 

96. The method as claimed in clafm 65, wherein the unlabeled digital data is obtained 
from a sample stream representing one or moreVchannels of digitized sound or music. 

97. The method of claim 96, wherein tne unlabeled digitized sound or music is 
obtained from either a master recording on digital auoio tape played on a digital tape recorder or 
a master recording on an analog audio tape played on an analog tape recorder and digitized via a 
digitizing interface. \ 

98. The method as claimed in claim 96, wherein tnis labeled digitized sound or music 
is subsequently recorded on a digital recording medium. \ 

99. The method as claimed in claim 98, wherein the digitVl recording medium is 
selected from the group consisting of a compact Disc (CD); a Digital Audio Tape (DAT); a Laser 
Disc (LD); a Video Compact Disc (VCD). \ 

100. The method as claimed in claim 65, wherein the watermark digital data includes 
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one or more of the following data items: an owner's logo; an owner's trademark; a personal 
identification; an artist's recorded voice; or general terms for publisher distribution. 

101 . A method for extracting digital watermarking image data or digital watermarking 
audio data from a digital image, audio, or Video data sample, said method including the steps of: 

a) inputting a set of labeled digital data and unique key data containing 
information of locations of watermark data im|Dosed as a label on the labeled digital data; 

b) mapping the set of labeleovdigital data into a format suitable for 
orthogonal transformation; \ 

c) performing an orthogonal transformation on the formatted labeled data to 
produce a set of labeled data transform coefficients; \ 

d) using the unique key to extract transform coefficients of orthogonally 
transformed watermark data from the locations in the set oHabeled data transform coefficients 
specified in the key; \ 

e) using an inverse orthogonal transformation on the transformed watermark 
data to retrieve the embedded watermark data. \ 

102. The method of claim 101 wherein the step of formatting the labeled data includes 
the step of mapping the set of labeled data into a two-dimensional matrix. 

103. The method of claim 102 wherein the step of formatting theNlabeled data includes 
the step of dividing the two-dimensional matrix of labeled data into smaller sub-blocks and the 
step of performing the orthogonal transformation on the labeled data involves performing the 
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orthogonal transform on each sub-b\pck of the labeled data, such that the labeled data transform 
coefficients are organized in sub-blocks. 

104. The method as claimed in Vlaim 103, including the step of ordering the orthogonal 
transformation coefficients of the labeled data in each sub-block into a one dimensional array in 
approximately increasing frequency order, as Vereinbefore defined, prior to extraction of the 
watermark data coefficients. \ 

105. The method as claimed in claim 104\ wherein the ordering step is achieved by 
performing a zig-zag scan of each sub-block of orthogonally transformed labeled data. 

106. The method as claimed in claim 104, wherein the ordering step is achieved by 
performing a radial scan of each sub-block of orthogonally Transformed labeled data. 

107. The method of claim 101, wherein after extraction of the watermark transform 
coefficients fi-om the orthogonally transformed labeled data, the extracted watermark data 
transform coefficients are arranged into a number of one-dimensioAal arrays corresponding to the 
number of sub-blocks used in the process of encoding the watermark Mata into the labeled data 
and each one-dimensional array is then reordered into a two-dimensional sub-block prior to 
performing the inverse orthogonal transform on the watermark data transtorm coefficients in 
each sub-block. \ 

108. The method of claim 107, wherein the reordering of each one-dimensional array 
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of watermark data transform coefi 
an inverse zig-zag scan. 

1 09. The method of claim 1 07,Wherein the reordering of each one-dimensional array 
of watermark data transform coefficients into a respective sub-block is achieved by performing 
an inverse radial scan. \ 

1 10. The method as claimed in claim k)l, wherein the transform coefficients of the 
watermark data embedded in the labeled digital data are compressed using a first scaling function 
and the method includes the step of expanding the compressed watermark data prior to the 
inverse orthogonal transformation using a second scalmg function which is an inverse of the first 
scaling function. \ 

111. The method of claim 110, wherein the inverse scaling function increases the 
magnitude of lower frequency coefficients of each one-dimen\ional array of watermark data to a 
greater extent than it increases the magnitude of the higher frequency coefficients of the 
respective one dimensional array. \ 

112. The method of claim 1 10, wherein the first scaling function has an exponential 
characteristic and the second scaling function has an inverse exponential characteristic. 

113. The method as claimed in claim 101, wherein the orthogonm transform performed 
on the labeled data is selected from the group consisting of a Discrete CosineyTransform (DCT); 
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ients into a respective sub-block is achieved by performing 
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lard transform; a Haar transform; a sine transform; and a 

-"^^^ 1 14. The method as claimeWn claim 113, wherein the orthogonal transform performed 

2 on the labeled data is a DCT. \ 

1 115. The method as claimed in claim 101, wherein the inverse orthogonal transform 

2 performed on the watermark data is selected\^om the group consisting of an inverse Discrete 
Cosine Transform (DCT); an inverse Fourier transform; an inverse Walsh-Hadamard transform; 

jV y 4-=^ an inverse Haar transform; an inverse sine transferm; and an inverse Wavelet transform. 

1 \ 

1."=^ 116. The method as claimed in claim 1 15\^ wherein the inverse orthogonal transform 

2f =1 performed on the watermark data is an inverse DCT. \ 

III \ 

l 117. The method as claimed in claim 101, including the further step of displaying the 

2^ watermark data samples for immediate examination or authentication. 

1 118. The method as claimed in claim 101, includinathe further step of storing the 

2 watermark data samples for future examination or authentication. 

1 119. The method as claimed in claim 101, wherein the landed digital data is obtained 

2 from a sample stream representing a digitized grayscale or color image. 
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120. The method as claimki in claim 119, wherein the labeled digitized grayscale or 
color image is obtained from a digital mill camera or a digital image scanner. 

121. The method as claimed in claim 101, wherein the labeled digital data is obtained 
from a sample stream representing digitized video. 

122. The method of claim 121, wherein the labeled digitized video is obtained from 
selected from the group consisting of a Video C6^mpact Disc (VCD) played on a VCD player; a 
Laser Disc (LD) played on a LD player; a Digital Versatile Disc (DVD) played on a DVD player; 
a digitized movie or still image contained within a video game or other software or a digital 
signal transmitted over a communications channel. \ 



123. The method as claimed in claim 101, wherein the labeled digital data is obtained 

\ 

from a sample stream representing one or more channels of digitized sound or music. 



1 24. The method of claim 1 23, wherein the labeled digitized sound or music is 
obtained from the group consisting of a Compact Disc (CD) played on a CD player; a Digital 
Audio Tape (DAT) played on a DAT player; a Laser Disc (LD) played on a LD player; from a 
Video Compact Disc (VCD) played on a VCD player. 

125. The method as claimed in claim 101, wherein the watermark digital data includes 
one or more data items selected from the group consisting of an owner's logo; an owner*s 
trademark; a personal identification; an artistes recorded voice; and general terms for publisher 
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1 126. A^apparatus for applying digital watermarking image data or 

( / 2 watermarking audioMata to an unlabeled digital image, audio, or video data sample, said 

3 apparatus including: \ 

4 a) inpW means arranged to input a set of unlabeled digital data; 

5 b) processing means arranged to process the unlabeled digital data to encode 

6 watermark data into the unlabefed data to form a set of labeled digital data; and 
7>f c) output means arranged to output the labeled digital data to a 

communication or storage medium, wherein the processing means is arranged to perform the 

1^ ^ ^(1 method as claimed in claim 65. \ 

\f-'% 111, An apparatus for extracting digital watermarking image data or digital 

il 1 watermarking audio data from a labeled digital \mage, audio, or video data sample said 

if^ apparatus including: \ 

4" a) input means arranged to input \ set of labeled digital data; 

5 b) processing means arranged to process the labeled digital data to extract 

6 watermark data encoded into the labeled digital data; and \ 

7 c) output means arranged to output the extracted watermark digital data to a 

8 display or storage means, wherein the processing means is arranged to perform the method as 

9 claimed in claim 101. \ 

1 128. A digital recording stored on any digital recording medimn, the recording 
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